Analyzing data from educational surveys: a comparison of HLM and Multilevel IRT
نویسنده
چکیده
Introduction During the last two decades, there has been an increased focus on educational quality and learning outcomes in the world. International educational surveys like TIMSS, PIRLS and PISA have provided a basis for assessing educational quality on different levels and corresponding influential factors. Using information provided by such large scale assessment, participating countries can explore weaknesses and strengths of their educational system comparing to other participating countries. International Association for the Evaluation of Educational Achievement (IEA) administers TIMSS and PIRLS for assessing Mathematics and Science and assessing Reading Literacy study.
منابع مشابه
Simple imputation methods versus direct likelihood analysis for missing item scores in multilevel educational data.
Missing data, such as item responses in multilevel data, are ubiquitous in educational research settings. Researchers in the item response theory (IRT) context have shown that ignoring such missing data can create problems in the estimation of the IRT model parameters. Consequently, several imputation methods for dealing with missing item data have been proposed and shown to be effective when a...
متن کاملMultilevel IRT Modeling in Practice with the Package mlirt
Variance component models are generally accepted for the analysis of hierarchical structured data. A shortcoming is that outcome variables are still treated as measured without an error. Unreliable variables produce biases in the estimates of the other model parameters. The variability of the relationships across groups and the group-effects on individuals’ outcomes differ substantially when ta...
متن کاملThe Use of Multilevel Item Response Theory Modeling in Applied Research: An Illustration
Embedding item response theory (IRT) models within a multilevel modeling framework has been shown by many authors to allow better estimation of the relationships between predictor variables and IRT latent traits (Adams, Wilson, & Wu, 1997). A multilevel IRT model recently proposed by Kamata (1998, 2001) yields the additional benefit of being able to accommodate data that are collected in hierar...
متن کاملInvestigating Multilevel Relationships in Information Systems Research : an Application to Virtual Teams Research Using Hierarchical Linear Modeling
Information Systems researchers are often concerned with empirical questions spanning more than one level of analysis. For example, virtual teams research provides a good illustration because such teams are inherently hierarchical entities involving the situated nature of individuals within teams. Despite the importance of multilevel research questions to Information Systems research, the liter...
متن کاملA Multilevel Bayesian Item Response Theory Method for Scaling Socioeconomic Status in International Studies of Education
A new method is presented and implemented for deriving a scale of socioeconomic status (SES) from international survey data using a multilevel Bayesian item response theory (IRT) model. The proposed model incorporates both international anchor items and nation-specific items and is able to (a) produce student family SES scores that are internationally comparable, (b) reduce the influence of irr...
متن کامل